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Introduction 


It is increasingly common for businesses, government, citizens and non-governmental 
organizations to find themselves participating in many collaborative efforts to solve 
environmental, social, and economic problems. They are doing so because collaborative 
approaches, it is commonly believed, lead to more comprehensive and acceptable outcomes at 
reduced cost than traditional regulatory and litigation-oriented approaches. Indeed, the PCSD, 
which is itself a collaborative process, recommended collaborative approaches to reform the 
environmental regulatory system, create an alternative regulatory path, and solve community- 
and ecosystem-based problems. The PCSD remains committed to collaborative strategies. 


Yet, the majority of participants in formal collaborative processes know that with this great 
promise comes great challenges. Success depends on many factors--some common sense, others 
less obvious, and many not always practiced or universally understood. For this reason, the New 
National Opportunities Task Force decided to examine some of the lessons that could be learned 
from a sampling of formal collaborative efforts now underway or recently completed. 
Specifically, the Task Force wanted to (1) document lessons learned from a diverse sample of 
collaborative processes; (2) identify when and under what circumstances collaborative 
approaches are useful and effective; (3) identify characteristics that are essential to successful 
collaborations and, conversely, the characteristics that cause collaborative processes to falter and 
fail; and (4) recommend next steps for evaluating collaborations. 


The working group reviewed existing academic literature on collaborations, a variety of written 
project evaluations where they existed, and other published and unpublished background 
materials for a number of high profile projects. The findings and recommendations presented 
below are based on these materials and the expertise of the PCSD working group. 


General Findings SE 
Cases Studies Evaluated 

1. Stakeholders often realize significant 

benefits through collaboration. nh gga 

Although not every problem can be sic Selene eteeennti Venn teeta igi 


solved through collaboration, people and _—_Great Printers Project 


rganizati llaborate because it (1 Pollution Prevention Pilot Project (4P) 
Gipen Gun w chem Gxt ome ae rs ltt ts Se 
Ows OWN SElI- Regulatory Negotiation (compendium of 8 cases) 


interests in ways consistent with others’ South Florida Ecosystem Restoration 

self-interests, (2) may result in equal or 3 | 

) env tal and social a CC 

at lower costs than traditional, more es 


adversarial approaches, (3) creates multi- 

stakeholder ownership of the process, outcomes and measures of success which can spur positive 
changes in policy and practice, and (4) may yield comprehensive geographic and sectoral 
solutions to complex societal problems by helping stakeholders understand each other’s needs, 
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recognize the needs of future generations and overcome institutional blind spots caused by 
narrow organizational missions, and traditional media-, pollutant-, or facility-specific 
approaches. For these reasons, PCSD remains committed to collaborative strategies. 


2.Collaboration is a process that is helping us learn how to solve society’s complex problems, 
and evaluation is a key to learning. Learning can and should take place during and after a 
collaborative process. During a collaboration, the parties can learn in real-time, track short-term 
milestones, and take proactive steps to ensure the success of the project or program. After a 
collaboration, the participants or others can look back to learn whether the overall program or 
subparts of it met their objectives, and how to improve future efforts. Both forms of evaluation 
are important, although we need to recognize the difference between proactive, real-time learning 
and retroactive, after-the-fact learning. In either case, stakeholders should be involved in the 
evaluation. In some instances, it may be useful to engage an outside expert or organization to 
help guide, direct and implement the data collection and analysis. If the parties to a collaboration 
have reached an impasse that causes a breakdown in the collaborative process, it may also be 
useful to seek the assistance of outside stakeholders to conduct the evaluation. 


3. Evaluations of collaborative efforts are rarely conducted either during or after a project. 
When they have been conducted, they are not usually designed at the outset of the project, with 
adequate involvement of the diverse stakeholders who have an interest ia the project’s success or 
failure, or, as may be useful in some instances, with outside professional expertise to guide and 
assist participants in creating the evaluation. These shortcomings often lead to recommendations 
with little, if any, stakeholder buy-in. Because many of the collaborations reviewed are “works 
in progress” and the available evaluation materials were limited, it is not possible to determine 
whether the efforts had succeeded or failed. Despite these constraints, the existing evaluation 
materials are useful for identifying specific features of collaborations that can strengthen the 
process and results (See Finding 5). 


4. Collaborations are becoming more complex and evaluation processes must adjust 
accordingly. \n the past, a partnership was often viewed as a one-time collaboration such as a 
regulatory negotiation (“reg neg”), where a single party governed the process, many players 
participated, and the process had a discreet endpoint (e.g., writing a rule). Now references to 
collaborations often mean something different. The Environmental Protection Agency’s (EPA’s) 
Project XL, Common Sense Initiative (CSI), and National Environmental Performance 
Partnership System (NEPPS) are themselves long term collaborative efforts to create institutional 
frameworks that foster many simultaneous mini-collaborations and sequential negotiations or 
projects. For example, the EPA set up the XL framework to foster facility-specific agreements 
that would deliver more innovative and protective environmental solutions than would be 
expected under existing regulatory requirements. These new approaches indicate a fundamental 
change in how society solves its problems and requires evaluations at two levels--the overall 
framework and individual projects. 
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5. Trust is essential and ownership of the process and outcomes fosters trust. Stakeholders’ 
trust in each other and in the “process” are the most important determinants of success for most 
projects. The most important determinant of trust is stakeholder ownership of the process, 
outcomes, and metrics of success. However, even when trust among stakeholders is difficult to 
obtain, collaboration can still be successful if the stakeholders trust the process. Although it is 
difficult to predict how much of an impact a particular problem will have on trust, it is certain 
that routine breakdowns in trust make it difficult to achieve the original goals of a project. 


There are specific “characteristics” of a formal collaboration’s objectives, process, and 
participants that will engender stakeholder trust and ownership. When present, they significantly 
increase the chances of success. A common theme underlying many of the characteristics is the 
importance of participants maintaining shared or equal power and influence. Not surprisingly, 
when collaborations first begin, influence and power are often unevenly distributed among the 
partners, with some partners having greater control over the process, resources and information. 
Success in collaboration seems closely linked to the ability of the participants to resolve or 
overcome these inequities. 


Key Characteristics of Collaborative P 
1. Characteristics of the Vision and Objectives 


Shared Vision and Objectives. Dedicating time and energy early in the process to define a shared 
vision and develop mutually agreeable objectives can be a powerful unifying and motivating 
force for project ownership. Collaboration works best when there is a clear agreement on what 
the group intends to achieve. A review of the literature suggests that it is common for projects to 
suffer from vaguely defined objectives, although most projects examined involved a combination 
of generally stated environmental and cost-reduction or effectiveness objectives. For example, 
EPA declared the vision of the CSI to be "cleaner, cheaper, and smarter." It has been difficult for 
stakeholders to translate this broad view into specific objectives since these stakeholders often 
disagreed about whether all parts of the objective could or should be advanced as co-equal 
priorities. In contrast, stakeholders in the Great Printers Project, agreed at the initial project 
meeting that making pollution prevention a standard business practice among lithographic 
printers could harmonize economic and environmental objectives. This provided purposeful 
direction for the discussions which followed. In South Florida, a mutually agreed vision of a 
healthy ecosystem that coexists with, and mutually supports, a sustainable economy provided a 
foundation for agreement on the primary objective of restoring more natural flows of water to the 
Everglades and other habitats. Overall, the case studies suggest that stakeholders should strive to 
be as specific as possible about their objectives early in the process, within their broadly agreed 
upon vision. When specificity is missing, stakeholders should be prepared to revisit the 
objectives later in the process. 


Measurable Outcomes. The case studies indicate a general consensus that (1) projects should 
focus on quantifiable environmental and economic results, (2) agreed upon measures can 
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strengthen ownership, and (3) a monitoring system should allow stakeholders to easily track 
results. Yet, in many of the case studies, performance measures do not exist. Where they exist, 
it is uncertain whether they are being used. The lack of specific and agreed-upon measures in 
Project XL, the CSI and NEPPS undoubtedly is responsible for some of the disagreements that 
have arisen in these projects. There are some notable exceptions, including the South Florida 
Ecosystem Restoration project and the CSI Metal Finishing sector’s strategic goals project. Note 
also that measures may be specific to an overall project--the NEPPS system as a whole--or a 
speciiic negotiated agreement--between EPA and a state environmental protection agency. Both 
are important. Despite the general lack of environmental and economic measures, all case 
studies examined (with the exception of the CSI and Project XL which cannot yet be fully 
evaluated) indicate a belief that they have had some successes. One of the lesser known benefits 
of stakeholder’s focus on outcomes has been discussions about developing baselines, tracking 


results, and collecting and reporting data. 


2. Characteristics of the Process 


Process is Equally Managed by Stakeholders. Shared management and decision making 
authority is often critical to success. The Great Printers Project (GPP), viewed by stakeholders 
as a great success, involved a unique triumvirate management structure, where the Council of 
Great Lakes Governors, the Environmental Defense Fund, and the Printing Industries of America 
jointly managed the process. When one stakeholder or the convening party is viewed as having 
more control over the process or outcomes of a project than the others, difficulties sometimes 
arise. This issue has arisen in the context of EPA’s Common Sense Initiative, where some 
participants perceive that EPA has a disproportionate share of control over the process. Since 
EPA is the agency responsible for making the regulatory changes that may be proposed under the 
CSI, the agency has a strong interest in the outcome and may unintentionally exercise 
disproportionate control of the process. 


Shared and Defined Decision Maki 
Process. Clearly defining both the decision 
rules and stakeholders’ roles in decision 
making early in the process is another critical 
feature for engendering ownership. When 
implemented correctly, a “consensus” 
decision rule is perhaps the most effective 


way to create ownership because it allows - Up-Front Planning 

participants to present their views honestly ne ee 

hil are. fFici power to Open Communications Among Participants 
their interests. Whatever the decision rules, 3. Characteristics of the Participants 
participants should have a role in developing ————e— 
them and share the power of decision re tenn ll evan: hin Goltieai 


making. The more participants have at stake, 
the more critical it is to define clearly the 


- Facilitators May Help and Should Apply Similar Tools. 


PCSD - Lessons Learned from Collaborative Approache s (April 17, 1997) 


Page 4 


Up-Front Planning. Organizations launching new collaborative efforts need advance plans for 
budgets and resources. Often, however, there is no such plan. The lack of planning, the reality 
that collaborative processes require more financial and human resources than many realize, and 
the routine delays in government procurement mean that it can take months or years to fund 
critical activities such as facilitation, research, travel, and consultants. The delays can deflate 
expectations and leave public interest organizations and small businesses without adequate 
resources to participate in the early stages of the process. The result may jeopardize stakeholder 
ownership. Public agencies often face these problems when they lead collaborative processes 
because new initiatives are typically launched quickly and with great fanfare, well after the 
agency’s formal budget planning process for that year has concluded. All of the case studies 
with direct and important federal participation faced these dilemmas. Budget planning has also 
affected the foundation community, as it has scrambled to keep up with requests from non- 
governmental organizations for resources to participate in collaborative efforts. 


Conflict Resolution. Conflict resolution has two important features that should also be clearly 
defined at the beginning of the collaborative process. First, a facilitated process with a 
professional facilitator or co-management team of stakeholders can avoid or resoive most 
conflicts before they escalate. Second, because all conflicts cannot be avoided, clearly 
articulated and collectively developed conflict management ground rules should be established. 
The GPP used small ad-hoc groups of representative stakeholders to resolve differences. A 
tiered approach that escalates issues to a higher level group or stakeholder-chosen decision 
making body may be a useful approach. A tiering approach will only work well, however, if 
decisions are dispatched quickly. The principal lesson is that when power is skewed, the process 
may collapse. When power is shared, the potential exists for outstanding results. 


Open Communications Among Participants. Open and transparent formal and informal 
communication is critical for trust and ownership. Information that is withheld, or that is 
suspected of being withheld, threatens trust. Yet, overloading stakeholders with written material 
is not helpful and can shut down communication. Participants should periodically identify what 
information is available and/or needed by each of the participants. The importance of informal 


communications--by phone, in person--or the exchange of draft documents can be even more 
important in building trust than formal communication. 


3. Characteristics of the Participants 


Balanced and Inclusive Stakeholder Participation. Balanced and inclusive stakeholder 
participation is critical and can be accomplished through a variety of techniques. “Balance” 
refers to the perspectives and interests that are brought to the collaboration. “Inclusivity” refers 
to the openness and reach of the invitation to participate. The objective, of course, is to find the 
“right” stakeholder:--stakeholders that have a substantial interest in the issue and/or a role in its 
resolution. The GFP is an example where an inclusive and committed core group systematically 


Se 
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brought in a wide network of local stakeholders throughout the Great Lakes Basin, resulting in a 
satisfying process. The South Florida Ecosystem Restoration project similarly increased 
stakeholder participation when Governor Chiles created the “Governor’s Commission for a 
Sustainable South Florida” to complement a federal interagency task force. While inclusive 
stakeholder involvement is desirable, it also can slow a process down considerably because it is 
more difficult to satisfy all interests. However, the cases reviewed seem to suggest that the 
greater the inclusivity at the beginning, the greater the potential for success, in spite of increases 
in time and energy required to create a more inclusive process. Failure to find creative ways to 
allow potential stakeholders to participate may cause a project to come to a halt when latent 
stakeholder issues re-emerge. 


Strong Leadership. Strong leadership is also a key to a successful collaborative process. For an 
organization such as the EPA that launches a new framework for cleaner, cheaper and smarter 
environmental protection such as the Common Sense Initiative, it is important to designate a 
leader or champion who provides strategic direction and moral support, secures or helps others 
secure financial support, and is willing to take risks to resolve an impasse in negotiations quickly 
and definitively. In South Florida the Governor’s Commission and the Interagency Task Force 
provided this leadership. In launching the NEPPS system, several state environmental 
commissioners played an important role in overcoming concerns that the NEPPS policy was 
developed by a small group of state and federal agency personnel. In this situation, the leaders of 
the effort emerged during the process. 


Create Capacity for Stakeholders to Understand Information. Because not all stakeholders come 
to a collaborative effort with the same knowledge or experience, it is typical for some 
stakeholders to feel left out of the process. This issue most often arises for citizens, public 
interest organizations and small businesses. It is important for all stakeholders who need them to 
have access to adequate information and financial and human resources to help them fully 
participate. Without this access, stakeholders may conclude they are being mislead or excluded 
by the other stakeholders. Whether they are actually being misled is largely irrelevant. Their 
belief usually cannot be overcome by either assertions to the contrary or piles of paper with 


Facili May Help and Should Apoly Similar Tools. In situations where stakeholders have 
significantly different perspectives, and do not begin a collaboration trusting one another or the 
process, a “third party” facilitator without a stake in the issue or debate can make a significant 
contribution to helping parties communicate and build trus:. The key to a facilitator’s success is 
involves helping participants establish a common vision and objectives, and develop clear 
decision making rules and conflict resolution processes at the beginning of the process. The 
facilitator must aisc b< able to anticipate conflict, help the group to resolve conflict and bring 
them back to the over-arching vision and objectives. Among a variety of challenges facing a 
facilitator is the potential for partiality that may arise because he or she has been hired by one of 
the stakeholders, and may, in turn, consult more frequently with that stakeholder. To overcome 


TT 
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this possible impression of impartiality, a facilitator must be sure to consult jointly and equally 
with all stakeholders. 


Recommended Next Steps 


Step 1. Create a guidebook based on the “Key Characteristics” identified in this summary 
report as well as other materials publicly available. Experience and the literature both strongly 
suggest that the single greatest determinant of success for a collaborative process is the extent to 
which it has engendered ownership and trust. 


Step 2. Existing and future collaborative projects should establish ongoing processes for 
multi-stakeholder evaluations. The processes should include opportunities to make mid- 
course corrections and evaluate a project at its completion. The PCSD’s search of the literature 
suggests that there is a shortage of comprehensive evaluations of specific collaborative processes 
conducted either during or after the collaboration. Even when they do exist, they have generally 
not been designed at the outset of the collaboration with input from all the stakeholders; nor have 
they clearly articulated interim milestones, final objectives, or feedback mechanisms to improve 
the process as it moves forward. 
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Methodology 


To undertake this “lessons learned evaluation, ” the New National Opportunities Task Force 
blished a multi-stakehold 1: (worki bership is listed furtl 
below). Participation on this working group included representatives from business, government 


As originally envisioned, the working group’s analysis was to include systematic evaluations, 
including interviews with stakeholders, of a select number of collaborative efforts. Given time 
be done properly or in the allotted time. Based on this concern, the working group agreed to 
search the literature for evaluations of recent collaborative efforts. The literature review focused 
on recent unpublished or soon to be published studies rather than on the academic literature 
because most of the collaborative efforts of interest have not yet been completed or have been 
completed only recently. It will be some time before peer reviewed academic studies are 
completed. Simultaneously, the working group developed a protocol for conducting interviews 
and unpublished academic literature were used to develop the protocol. 


To conduct the review of existing evaluations, working group and task force members nominated 
dozens of case studies of collaborative processes. Working group members then searched for 
available written material, developed a set of case selection criteria, screened the cases against 
those criteria, and developed a shorter list of case studies to examine. 


The process of selecting case studies revealed that very few systematic studies of collaborative 
processes have been conducted. Two exceptions were the “Report of the Interagency Ecosystem 
Management Task Force” and the “Great Printer’s Project” recently completed mid-term 
evaluation. There was no multi-stakeholder study of the U.S. Environmental Protection 
Agency’s Project XL or Common Sense Initiative, although the Global Environmental 
Management Initiative had just completed its review of both programs. The materials reviewed 
varied in quality, comprehensiveness, purpose and possible biases. From these limitations arose 
ihe Task Force’s initial recommendations to ensure that rigorous evaluations are undertaken in 
the future and that they are conducted with appropriate stakeholder input throughout a project. 
Despite the limitations of the available materials, there was information useful to the working 
group. 


Time constraints, the volume of material, and the working group’s intent to proceed by 
consensus raised several challenges in drawing useful and valid conclusions from the materials. 
The working group agreed to assign each member of the working group with responsibility for 
reviewing several case studies in depth and for becoming familiar with as many other case 
studies as possible. Working group members used the draft research protocol as a template for 
their reviews. 
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During several day-long, facilitated meetings, the working group systematically reviewed each 
case study identifying how the case materials addressed the following issues: (1) stakeholder 
participation, (2) clarity of objectives, (3) decision making processes, (4) conflict resolution 
processes, (5) communications among participants, (6) available information and resources 
(technical and financial), (7) outcomes (environmental results and cost-effectiveness) and (8) 
measurability of the outcomes, (9) indirect benefits, and (10) miscellaneous issues not captured 
in the other categories. In some cases, working group participants had personal experiences with 
the case studies and their personal experiences were noted. After lengthy discussions of the case 
studies the working group was able to reach concensus on overal conclusions about the case 
studies. These conclusions were presented to and approved by the full Task Force. 
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Summary of Projects Evaluated 


L. EPA’s Commor Sense Initiative (CSI) 

CSI is an experimental collaborative effort to achieve cleaner, cheaper and smarter 
environmental regulation. For each of six industries, known as “sectors” in the CSI program, 
representatives of industry; environmental groups; community groups; environmental justice 
groups, labor; and Federal, state, local, and tribal governments are gathered together. These 
teams develop innovative approaches to environmental problems, and former adversaries often 
become partners in protecting the environment. For each “sector” in the CSI program, EPA 
convenes a team of stakeholders that looks for opportunities to change complicated and 

future. Sector teams and working groups meet frequently to discuss the progress of various 
forwarded to the CSI Council, comprising high-level decision makers from all the stakeholder 
groups and across all involved industries. The Council then makes recommendations to EPA on 
how to change national policy. The six industries are: automobile manufacturing, computer and 


2 EPA's Project XL 

President Clinton created the XL (eXcellence 2zad Leadership) programs with his March 16, 
1995, Reinventing Environmental Regulation iitiative. He described XL projects as giving the 
regulated community the opportunity to demonstrate excellence and leadership by developing 
projects that result in superior environmental performance in partnership with regulators and 
members of the general public when provided with the flexibility to pursue alternatives to the 
current regulatory system. XL projects are real-world tests of innovative strategies to achieve 
cleaner and cheaper results than would be achieved under conventional regulations. Each project 
involves the granting of regulatory flexibility by EPA in exchange for commitinents by a 
regulated entity to achieve better environmental results than would have been attained through 
strict compliance with regulations. EPA requires that projects include an evaluation component 
to assess such issues as environmental results, regulatory burden reduction, and level of 
community stakeholder involvement. 


3. EPA's National Environmental Performance Partnership System (NEPPS) 

The National Environmental Performance Partnership System, signed by the EPA Administrator 
and State environmental leaders on May 17, 1995, is designed to give strong state programs more 
leeway to set environmental priorities, design new strategies, and manage their own programs, 
while concentrating EPA oversight and technical assistance on weaker programs. The major 
components of this agreement include increased use of environmental goals and indicators, state 
assessments of environmental and program performance, environmental performance 

EPA's program also offers Performance Partnership Grants (PPG) to states. A PPG is a grant 
that combines two or more specific programmatic grants into a single grant. The grants are 
intended to allow states to focus their grant resources to address high priority projects. The 
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process of negotiating these grants follows a similar process to that required under the NEPPS 
described above. 


4 Great Printers Project 

This project began in 1993 with the goal of making pollution prevention a standard business 
practice for the lithographic printing industry in the Great Lakes region. The Great Printers 
Project is a collaborative effort to enable and motivate printers (generally smal! businesses) to 
integrate pollution prevention into shop operations in order to reduce environmental impacts and 
save money. The project is a partnership of the Council of Great Lakes Governors, the 
Environmental Defense Fund, and the Printing industries of America with strong EPA 
endorsement and support. The project's recommendations focus on enrolling print shops 
committed to furthering “Great Printers principles”, informing and influencing customer 
industry-specific access to technology and financial resources 


5. Pollution Prevention Pilot Project (4P) 

4P is a joint effort undertaken by representatives of the environmental communsty. industry and 
government regulators. Managers of the 4P envision an improved regulatory statutory 
framework which encourages environmental excellence and pollution prevention on a 
multimedia, facility-wide basis. The overall] objective ts to determine whether and under what 
benefits at lower costs and in a credible, enforceable and predictable manner. The project 
appropriate steps that should be taken by environmental policy makers. 


6 PCSD | - Eco-Efficiency Auto Project 

The President's Council on Sustainable Development created the Eco-Efficiency Task Force 
(EETF) to identify modeis of sustamable manufacturing, pollution prevention and product 
stewardshap. Having thus identified key models, the charge was to make recommendations for 
policy change. The auto team was one of four demonstration teams of the EETF. The broad 
goals of this team were to: (1) improve the “eco-cfficiency™ of automobile manufacturing by 
practice, and, (2) improve the system of environmental policy and regulation affecting 
automobile manufacturing. By initiating work toward these goals. the team's activities will heip 
reduce the environmental mmpact associated with road-based transportation. 


7. Regulatory Negotiation (compendium of 8 cases) 

“Regulatory Negotiation” is the most formai of the Federal Govermment s+ consensus-based 
approaches. In these “reg neg™ processes, EPA and representatives of all major groups affected 
by a particulars regulation try to reach agreement on regulatory requerements. Thes process not 
Even when full agreement cammot be reached. regulatory negotiation can heip identify meues and 
options, educate micrested parties, and narrow arcas of despute The Admonestrative Conference 
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of the United States supported a study which evaluated eight negotiated rulemakings undertaken 
by EPA. The 8 reg negs included Woodstoves, Asbestos in Schools, Hazardous Waste (or 
underground) Injection, Hazardous Waste Manifest, Minor Permit Modifications, Coke Ovens, 
Fugitive Emissions, and Clean Fuels. 


8. South Florida Ecosystem Restoration 

The South Florida Ecosystem Restoration Project was designed by the Interagency Ecosystem 
management Task Force in response to a mandate by Vice President Gore in his National 
Performance Review (NPR). The NPR called for the agencies of the Federal Government to 
adopt a “proactive approach to ensuring a sustainable economy and a sustainable environment 
through ecosystem management.” A working group was formed to examine ecosystem efforts in 
South Florida to date, identify barriers to implementing an ecosystem approach, and identify 
ways in which the Federal Government could assist in overcoming these barriers. The South 
Florida Ecosystem Restoration Working Group examined major issue areas that influence the 
effectiveness of the ecosystem approach, such as funding institutional arrangements, public 
participation, science and information and legal authority. 
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